Temporally coherent person matting trained on fake-motion dataset
نویسندگان
چکیده
We propose a novel neural-network-based method to perform matting of videos depicting people that does not require additional user input such as trimaps. Our architecture achieves temporal stability the resulting alpha mattes by using motion-estimation-based smoothing image-segmentation algorithm outputs, combined with convolutional-LSTM modules on U-Net skip connections. also fake-motion generates training clips for video-matting network given photos ground-truth and background videos. apply random motion their simulate movement one would find in real composite result clips. It lets us train deep neural operating an absence large annotated video dataset provides training-clip foreground optical flow use loss functions.
منابع مشابه
Towards Temporally-Coherent Video Matting
Extracting temporally-coherent alpha mattes in video is an important but challenging problem in post-production. Previous video matting systems are highly sensitive to initial conditions and image noise, thus cannot reliably produce stable alpha mattes without temporal jitter. In this paper we propose an improved video matting system which contains two new components: (1) an accurate trimap pro...
متن کاملA Bilinear Model for Temporally Coherent Respiratory Motion
We propose a bilinear model of respiratory organ motion. The advantages of classical statistical shape modelling are combined with a preconditioned trajectory basis for separately modelling the shape and motion components of the data. The separation of a linear basis into bilinear form leads to a more compact representation of the underlying physical process and the resulting model respects the...
متن کاملTemporally coherent stereo: improving performance through knowledge of motion
This paper introduces the idea of temporally extending results of a stereo algorithm in order to improve the algorithm's performance. This approach anticipates the changes between two consecutive depth maps resulting from the motion of the cameras. Uncertainties in motion are accounted for by computation of an ambiguity area and a resulting disparity range for each pixel. The computation is use...
متن کاملTemporally coherent conservative visibility
EEciently identifying polygons that are visible from a changing synthetic viewpoint is an important problem in computer graphics. Even with hardware support, simple algorithms like depth-buuering cannot achieve interactive frame rates when applied to geometric models with many polygons. However, a visibility algorithm that exploits the occlu-sion properties of the scene to identify a superset o...
متن کاملBayesian Video Matting Using Motion Based Segmentation
Video matting attempts to extract foreground images from an image sequence, as well as the alpha-mattes that describe their transparency. This papers presents an automated video matting framework using motion-based segmentation and bayesian matting. We build upon existing techniques for layer segmentation based on optical flow to generate a coarse trimap, by identifying image pixels as belongin...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Digital Signal Processing
سال: 2022
ISSN: ['1051-2004', '1095-4333']
DOI: https://doi.org/10.1016/j.dsp.2022.103521